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DUAL-PORT BUFFER-TO-MEMORY INTERFACE 

FIELD OF THE INVENTION 
This present invention relates generally to digital memory devices and systems, and 
5 more particularly to memory module architectures and methods for operating such devices 
and systems. 

BACKGROUND OF THE INVENTION 
Microprocessors, digital signal processors, video devices, and many other types of 
digital data processing devices rely on an attached high-speed memory system to hold data 
1#! and/or processor instructions needed by the processing device. As these processing devices 
2f become faster and more powerful, the increased demands placed on them generally translates 
n t to a need for larger and faster attached memory systems. 

s Figure 1 depicts a typical memory system configuration. One or more memory 

C? devices 26AA, 26AB, 26BA, 26BB, 26CA, and 26CB interface with a memory controller 20 
lil through memory bus 22. A host (e.g., a central processing unit (CPU), not shown) also 
^ connects to memory controller 20 through a front-side bus FSB. The memory devices hold 
data in arrays of addressable memory cells. Memory controller 20 controls the exchange of 
data between the host and the memory storage devices. 

Memory bus 22 carries memory signals on a collection of signal lines. Memory 
20 signals fall generally into one of several categories including clock and control signals, 

address signals, command signals, and data signals. Data signals carry the actual data that 
will be stored in, or retrieved from, a memory device. Address signals specify the location 
within a memory device where data is to be read from or written to, and may also select 
which of several memory devices is to be accessed. Command signals instruct a memory 
25 device as to what type of operation is to be performed, e.g., read, write, refresh, and possibly 
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as to which of several access modes (such as a burst mode) should be used for a data transfer. 
Clock and control signals synchronize the other signals passing between controller 20 and the 
memory devices. Although memory bus 22 may use a separate signal line for each memory 
signal (e.g., 32 address lines to transfer a 32-bit-wide address in one clock cycle and 32 data 
5 lines to transfer a 32-bit-wide data word in one clock cycle), various schemes also exist to re- 
use one or more signal lines for different memory signals during different clock cycles of a 
memory transaction. 

In the configuration shown in Figure 1, memory bus 22 is a multi-drop memory bus. 
In other words, bus 22 is arranged with a backbone of signal lines. A signal line stub, or 
"drop", connects each of the memory devices (e.g., 26A) to the backbone. Typically, 
gyi memory bus 22 will comprise a collection of leads routed on a printed circuit board 21 known 
y | as the "main board" or "motherboard". Memory controller 20 mounts to motherboard 21 and 
s connects to one end of the leads comprising memory bus 22. Each drop of memory bus 22 
*f J connects to an electrical terminator, or socket. A typical main board contains multiple 
IjSj memory sockets, e.g., the three sockets 28A, 28B, and 28C shown in Figure 1 . 

Memory is added to the memory system by inserting memory modules (e.g., 24A, 
24B, 24C) into one or more of the sockets. One popular type of memory module is a Dual 
In-line Memory Module, or DIMM. The DIMM is a rectangular low-profile circuit board 
that has electrical contact points arranged on both sides along one long edge. The contact 
20 points form electrical connections to the main board's memory bus when the DIMM is 
inserted into a DIMM memory socket. 

A DIMM generally has multiple individual memory devices mounted to it. The 
devices all work in parallel to perform memory functions. For instance, a DIMM may have 
eight memory devices, each of which receives the same memory address from the controller. 
25 If the size of a data word is 32 bits, each of the memory devices is responsible for four bits of 
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the data word that is placed on the memory bus. 

Some DIMM designs (like the design shown in Figure 1) have more than one bank of 
memory devices. For example, Figure 2 shows a block diagram of a registered DIMM 24 
containing eighteen memory devices arranged in two banks, one bank containing devices 
D00-D08 and the other containing devices D10-D1 8. In a registered DIMM, the system 
clock CKO is received by phase-locked-loop (PLL) 27, which creates a set of module clock 
signals. Address and command signals ADD/CMD are latched into a register 25 at the edge 
of one clock cycle, and then redriven onto the module addressing/command bus as register 
signals RADD/RCMD on the following clock cycle. Note that two bank select signals, 
B0_SEL# and B1_SEL#, each pass through register 25 and connect to a chip select pin on a 
corresponding one of the banks of memory devices. The data lines DQ of the memory device 
banks each connect to the memory bus of the host system. A total of nB DQ lines carry data 
signals, where B is the number of devices in one bank (e.g., eight or nine), and n is the data 
width of each device (e.g., four, eight, or sixteen bits). In addition, B DQS lines carry data 
strobes (one per device). The DQS data strobes travel with the data signals, and can be used 
for source-synchronous clocking of the data signals at the receiver. 

Figure 3 shows a timing diagram for two consecutive random reads to memory bank 
D00-D08. At Tl, the memory controller transmits an ACTIVE command along with a ROW 
address, and takes B0JSEL# low to select bank 0 on module 24. Register 25 latches these 
signals, and places them on the module bus at T2. After a known RAS (row address strobe) 
latency, the controller transmits a READ command along with a COL "a" address. These 
signals also pass through register 25 with a one-clock cycle delay. After a known CAS 
(column address strobe) latency, the memory bank places data (DO a) from ROW and COL 
"a" onto bus lines DQ, and DQS is driven as well. Note that a read to a COL "b" can 
immediately follow the first read, as the columns are on the same ROW. 
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BRIEF DESCRIPTION OF THE DRAWING 

The invention may be best understood by reading the disclosure with reference to the 
drawing, wherein: 

Figure 1 illustrates an edge view of a prior art memory system; 

Figure 2 contains a block diagram a prior art registered DIMM; 

Figure 3 shows a timing diagram for two consecutive read operations for the 
registered DIMM of Figure 2; 

Figure 4 shows a block diagram for a memory module according to one embodiment 
of the invention; 

Figure 5 shows a timing diagram for two consecutive read operations for the memory 
module of Figure 4; 

Figure 6 shows a timing diagram for two consecutive write operations for the memory 
module of Figure 4; 

Figures 7 and 8 show, respectively, a side view for a general DIMM module layout 
for the memory module of Figure 4, and a side edge view of multiple DIMM modules of this 
type connected to a multi-drop memory bus; 

Figure 9 shows a block diagram for a memory module interface circuit useful with 
another embodiment of the invention; 

Figures 10 and 1 1 show, respectively, a side view for a general DIMM module layout 
for the memory module using the interface circuit of Figure 9, and a side edge view of 
multiple DIMM modules of this type connected to a point-to-point virtual multi-drop memory 
bus; and 

Figures 12 and 13 show, respectively, a side view for a general DIMM module layout 
using a variation of the interface circuit of Figure 9, and a side edge view of multiple DIMM 
modules of this type connected to a point-to-point ring memory bus. 
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DETAILED DESCRIPTION OF THE EMBODIMENTS 
The dual-bank registered DIMM design of Figure 2 has at least one desirable 
characteristic when compared to a single-bank design — for a given memory capacity on each 
device and a fixed memory bus width, the dual-bank design allows the capacity of the DIMM 
5 to double. A dual-bank DIMM can generally be manufactured for less than twice the cost of 
a single-bank DIMM and is therefore cheaper than two single-bank DIMMs. Dual-bank 
DIMMs can also be desirable where the number of DIMM sockets on a motherboard is 
limited. 

The present disclosure includes a group of buffered memory module architectures. 
H| Generally, the disclosed embodiments use a memory module interface circuit that, in essence, 
p» widens the data bus on the memory module as compared to the width of the system memory 
y 1 data bus, allowing a faster system memory data bus to operate at full speed with slower 
s memory devices. Preferably, this characteristic of the module is transparent to the memory 

system and to the memory devices: to the memory system, it appears that the module 
lJSS comprises memory devices that operate at the full speed of the memory system data bus; to 
the memory devices, it appears that each is connected to a controller operating at a slower 
speed compatible with the devices. This allows for an embodiment that is compatible with an 
existing memory controller/bus and with existing memory devices. 

The memory module configurations and access methods disclosed herein can improve 
20 on the dual-bank registered DIMM in several respects. For instance, one embodiment 
describes a DIMM that can, with the same type of devices, number of devices, and data 
signal pins as the dual-bank registered DIMM, provide twice the data rate of the registered 
DIMM. This configuration can also allow the memory devices to operate at voltage levels 
independent of the voltage levels of the memory system that the module is attached to. The 
25 exemplary embodiments also allow the memory devices to be isolated from the full 
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capacitive loading effects of the system memory data bus. Further, the memory devices of 
the embodiments avoid arrangements of competing memory banks that load each other, as is 
the case with a dual-bank DIMM. Finally, with the disclosed embodiments there is less need 
for complex logic, within the memory devices themselves, in order to increase the bandwidth 
of the memory system. 

It is recognized herein that the multi-drop memory bus architecture also has several 
characteristics that limit its expansion to greater numbers of memory devices and/or faster 
bus speeds. First, the stubbed bus architecture can create undesirable reflections on the signal 
lines at high frequency. Overall bus length can also cause timing problems that limit 
operational frequency, as at high frequency a significant skew will be observed between 
when a memory signal arrives at a closer device vs. when that signal arrives at a device 
further down the bus. The length of the bus and the number of device inputs also determine 
the capacitance that a memory device (or the controller) sees when it drives the bus— at 
higher frequencies, this capacitance may make it infeasible to drive signals reliably on the 
bus. 

The memory systems and modules described herein generally improve upon the 
multi-drop memory bus architecture by isolating the memory devices on each module from 
the bus, while providing retiming at the interface circuit of each module. Some of the 
disclosed embodiments go even further, by adding a dual port buffer to the module data port 
of the interface circuit. The dual-port buffer allows a primary memory controller and the 
modules to be connected in a point-to-point architecture. In this architecture, each memory 
module communicates directly with only its two nearest neighbors. Memory signals are 
forwarded from module to module until they reach the controller or the module that they are 
addressed to. 

Figure 4 illustrates a block diagram for one embodiment of a memory module 100. 
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Memory module 100 contains three functional blocks; a module controller 1 10; a data 
interface circuit 120; and a memory device array 140/142. 

The module controller 110 synchronizes the operation of module 100 with the 
attached memory system. Like the address/command registers and PLL of a registered 
5 DIMM, controller 110 can provide clock adjustment to an input CLK signal and registered 
versions of address and command signals, RADD/RCMD. In addition, module controller 
110 provides timing and synchronization signals to data interface circuit 120. The function 
of the various timing and synchronization signals shown in Figure 4 will be explained 
shortly. 

l'ff Data interface circuit 120 provides for -bit- wide data transfers between the module 

~i and the system memory data bus, and fori? x m -bit-wide data transfers between the interface 
yl circuit and the memory device array. In Figure 4, R = 2, i.e., the memory device array 
s comprises two memory device ranks 140 and 142, each capable of performing m-bit-wide 
^ J data transfers. As used herein, a rank of memory comprises enough memory devices to form 
Yfit a data path that is m bits wide. Generally, multiple ranks will receive the same address and 
commands, and will perform memory operations with the interface circuit concurrently. 

In Figure 4, a bi-directional buffer 122 is coupled to a bi-directional module data port 
that can be connected to a system memory data bus. An m-bit-wide path through buffer 122 
receives and drives data signals DQ on the system memory data bus. Optionally, a set of data 
20 mask bits DM can be accepted at the data port and redriven towards the memory array. The 
data mask bits allow the memory controller to selectively write a subset of an m-bit-wide set 
of data signals. For instance, with a 64-bit word size, an eight-bit mask DM can be used to 
specify that any combination of the eight bytes making up the word should not be written to 
memory. Finally, a data strobe signal DQS can be driven by buffer 122 onto the memory 
25 data bus. 
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Two bi-directional data registers 126 and 128 connect, respectively, to memory 
device array ranks 140 and 142. Each data register can receive an m-bit-wide word from its 
corresponding memory device rank, or drive an /rc-bit-wide word to that rank, over a 
dedicated point-to-point module data bus. When the optional data-masking signal feature is 
5 implemented, each data register can also drive a registered data-mask signal (e.g., RDMO for 
register 126) to its corresponding rank when the register data is written to memory. 

Multiplexer/demultiplexer (MUX/DeMUX) 124 has a multiplexing ratio R. In Figure 
4, either data signals DQO (from register 126) or data signals DQ1 (from register 128) can be 
multiplexed to buffer 122 when the module is reading from memory device array 140/142. 
ljft Likewise, when the module is writing to the memory device array, data signals MDQ from 
£ll buffer 122 can be channeled to either DQO or DQ1 . 

Ill Module controller 110 synchronizes the operation of the data port buffer 122, 

s MUX/DeMUX 124, and data registers 126 and 128 via a number of control signals. For 

instance, direction signal DIR specifies whether data flow is towards the memory array (TO) 
l%l or away from the memory array (AWAY). Module controller 110 determines the current 
value for DIR by snooping CMD signals as they pass through controller 110, For instance, 
DIR can default to TO, and switch to AWAY when the command signals latched into RCMD 
indicate an impending READ operation. When DIR is set to TO, buffer 122 is configured as 
a receiver (viewed looking in to circuit 120), MUX/DeMUX 124 is configured as aDEMUX, 
20 and registers 126 and 128 are configured as drivers (viewed looking in to circuit 120). When 
DIR is set to AWAY, buffer 122 is configured as a driver, MUX/DeMUX 124 is configured 
as a MUX, and registers 126 and 128 are configured as receivers. 

The register select signal REGJSEL, in the AWAY mode, determines whether DQO 
or DQ1 will be supplied to buffer 122. Data is serialized from the data registers onto the 
25 memory data bus by reading 2m bits into the data registers during one memory device read 
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cycle, and then driving these bits, m at a time, through MUX 124. For instance, REGSEL 
can first select, e.g., DQO during a first bus clock cycle, and then DQ1 during the following 
bus clock cycle. In the AWAY mode, register data strobe RDQS is functional. When RDQS 
transitions, buffer 122 latches data from MUX 124 and drives that data onto the memory data 
5 bus. 

In the TO mode, REGJSEL determines which of registers 126 and 128 will receive 
DQ at each memory bus clock cycle (note that an alternative is to supply DQ to the inputs of 
both registers, and ignore REGSEL). In the TO mode, register data strobes RDQSO and 
RDQS1 are also functional. When RDQSO transitions, register 126 latches data from DQO 
l|{ (and DM0). When RDQS1 transitions, register 128 latches data from DQ1 (and DM1), In 
pi one memory bus clock cycle, m bits are directed to register 126 by strobing RDQSO. In the 
ill following bus clock cycle, m bits are directed to register 128 by strobing RDQS1 . Both 
B register contents are then written to memory device array 140/142 during a single device 
bz write cycle. Controller 110 strobes the memory device array, using the memory data strobe 
lpj MDQS, to signal the array to write data from buses RDQO and RDQ1 . 

Figure 5 illustrates a timing diagram for two consecutive read operations (to the same 
ROW of the memory devices) on module 100 of Figure 4. Externally, a primary memory 
controller initiates READ operations just like it would for a registered DIMM (see the 
description accompanying Figure 3). When controller 110 latches an active command into 
20 RCMD, it enters an ACTIVE state itself. In the ACTIVE state, controller 110 scans the 

command bus for READ or WRITE commands, as these commands signal that controller 110 
will need to synchronize a data transfer. At T4, a READ command (to COL a) is clocked in, 
causing the controller to enter a READ state. At T5, a second READ command (to COL b) is 
clocked in; controller 110 counts the number of pending READ operations (including each 
25 operation's burst length if the devices support burst mode access) in order to track how long 
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to stay in the READ state. 

Controller 110 asserts DIR (where asserted equals AWAY) sometime after passing 
the first READ command to device array 140/142. This assertion time can vary, but 
preferably occurs prior to when device array 140/142 is expected to begin driving buses 
RDQO and RDQ1. Device array 140/142 signifies that it is about to drive data onto buses 
RDQO and RDQ1 by taking data strobe MDQS low at T6n. Note that typically, MDQS will 
comprise multiple strobes, each device in device array 140/142 supplying at least one strobe 
synchronized to its data signals. Module controller 1 10 senses the transition on MDQS— this 
causes module controller 1 10 to take register data strobe RDQS low in turn, thereby signaling 
to the primary memory controller that data transfer is about to occur. 

At T7n, device array 140/142 takes MDQS high, signifying that data outputs 
"DO_al " and "DO_a2" are being driven respectively onto buses RDQO and RDQ1 at that 
time. Delay element 134 delays MDQS long enough for the buses to settle, and then passes 
the MDQS strobe to registers 126 and 128. Upon receiving MDQS, registers 126 and 128 
latch DO_al and DO_a2 (note that with multiple strobes coming from multiple devices, each 
strobe may be used to latch the data signals coming from its device). Note that DQ0 and 
DQ1 contain valid data shortly after the data first appears on RDQO and RDQ1 . 

Controller 1 10 also receives strobe MDQS. The positive transition of MDQS triggers 
two controller signals: a delayed (to correspond approximately with the appearance of valid 
data on DQ0 and DQ1) positive transition on strobe RDQS; and a corresponding negative 
transition on REGSEL to steer DO_al to buffer 122. The multiplexer output trace MDQ 
shows that concurrent with the transition of REG_SEL, DO_al begins to stabilize at the input 
to buffer 122, and is stable before T8. 

RDQS, along with the contents of DQ0, are latched into register 122 based on the 
transition of RDQS. A delay element 132 is used to ensure that RDQS has settled at the input 
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of buffer 122 before it is latched. Shortly before T8, MDQ and RDQS are latched into buffer 
122, and appear at the memory bus port as DQ and DQS shortly after T8. 

Approximately a half-clock cycle after transitioning RDQS and REG_SEL, controller 
1 10 transitions these signals again to place DO_a2 on the memory bus. While DO__a2 is 
being latched into buffer 122 (at T8n) ? the memory devices begin data output of the results of 
the second READ operation. The results of the second read operation propagate through the 
interface circuit in similar fashion to the results of the first read operation. The net result is 
that the memory data bus transfers Am bits of data in two memory bus clock cycles (four m- 
bit transfers), with only two data accesses performed at each memory device on the module. 

Figure 6 shows an analogous timing diagram for two consecutive write operations. 
Like in the case above, module controller 110 enters an ACTIVE state upon latching the 
ACTIVE command from the primary memory controller. Upon sensing the first WRITE 
command, module controller 110 transitions to a WRITE state. This includes taking RDQSO 
(and RDQS1, if desired) low in preparation for the first write operation. 

DQS is center-aligned with the write data placed on DQ by the primary memory 
controller. Accordingly, DQS is used to clock DQ (and DM) into buffer 122 when DQS 
transitions at T5. Between T5 and T5n, DI al is valid on MDQ, as well as on DQO and DQ1 
(DeMUX 124 merely passes MDQ to the inputs of both data registers in this example). 

Module controller 110 also receives DQS. After a delay to allow the inputs to register 
126 to settle, module controller 1 10 transitions RDQSO to latch DI_al into register 126. 

At T5n 5 the primary memory controller transitions DQS again, causing buffer 122 to 
latch DI_a2. After a delay to allow the inputs to register 128 to settle, module controller 110 
transitions RDQS1 to latch DI_a2 into register 128. 

Note that in some embodiments, register 126 may have separate input and output 
stages— this allows register 126 to hold its output long enough to ensure that the memory 
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device array receives it, while at the same time allowing register 126 to latch the next input 
from DQ. When such an arrangement is used, RDQS1 can be used as a transfer signal to 
cause register 126 to transfer the contents of its input stage to its output stage. In Figure 6, 
this method of operation is illustrated by the two separate traces RDQ0_IN (input stage) and 
RDQ0_OUT (output stage). 

Figure 7 shows the general component arrangement for a memory module 100 in a 
DIMM form factor. Two ranks of memory devices are arranged along the top of the DIMM 
card: memory devices 140A-140H are arranged on the facing side of the module, with 
memory devices 142A-142H arranged directly behind these (see the side view of module 
100A in Figure 8). Interface circuit 120 of Figure 4 is split into two identical interface 
circuits (left circuit 125 and right circuit 130) in Figure 7, each handling half of the data lines. 
This arrangement allows for more uniform lead lengths between an interface circuit and each 
of the memory devices, and reduces the pin count on each interface circuit package. In 
Figure 7, the data signal lines for one memory rank are arranged on the front side of the card 
(solid lines leading to the memory devices), and the data signal lines for the other memory 
rank are arranged on the back side of the card (dashed lines leading to the memory devices). 
Module controller 1 10 is centered below the memory modules, equalizing signal distance to 
interface circuits 125 and 130. This arrangement also provides a more uniform path length 
for address and command signals RADD/RCMD. The signals labeled "SYNC" include the 
signals DQS, RDQS, DIR, REGJSEL, RDQS0, and RDQS1 shown in Figure 4. 

Figure 8 shows three of the modules depicted in Figure 7 arranged in a memory 
system with a primary memory controller 20 and a multi-drop memory bus 22. Note that 
with multiple modules, each module will recognize ACTIVE commands addressed to that 
module and respond accordingly; otherwise, the modules remain in a standby mode and need 
not pass commands through to their memory device arrays. 
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Figure 9 illustrates an alternate interface circuit configuration 170 useful with a point- 
to-point memory data bus. Most of interface circuit directly corresponds to interface circuit 
120 (MUX/DeMUX 176 and everything to the right of it). But the data port buffer in Figure 
9 is a dual-port data buffer, with a forwarding buffer 174 and a transfer buffer 172. 

Communication between the primary memory controller and the interface take place 
at the transfer port, which comprises data signal lines TDQ, data masking signal lines TDM, 
and data signal strobe lines TDQS. A forwarding port comprises data signal lines FDQ, data 
masking signal lines FDM, and data signal strobe lines FDQS. The forwarding port allows 
for communication between the memory module and another memory module on an 
additional memory bus segment. 

In operation, transfers between the memory module and the primary memory 
controller function similarly to those described for Figure 4. But when a set of data signals is 
received at the forwarding port, those signals are clocked in and then clocked out on the 
transfer port during the next bus clock cycle. And when a set of data signals is received at the 
transfer port while the memory module is not ACTIVE, those signals are clocked in and then 
clocked out on the forwarding port during the next bus clock cycle. 

Figure 10 shows the general component arrangement for a memory module 150 
arranged in a DIMM form factor and employing the interface circuit layout of interface 
circuit 170. The general arrangement of module 150 is similar to that of module 100 of 
Figure 7, with interface circuit 170 split into two halves 175 and 180. The number of 
memory data bus connections along the card edge, however, has been doubled to facilitate 
support for a transfer port and a forwarding port. Note also that two address and command 
ports to module controller 160 are also shown — one port accepts transfer address and 
commands (TADD/TCMD) from an attached memory controller, and the other port transmits 
forwarded address and commands (FADD/FCMD) to other downstream modules. 
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Figure 1 1 shows three of the modules depicted in Figure 10 arranged in a memory 
system with a primary memory controller 200 and a point-to-point memory bus 202. This 
memory bus is described as a "virtual multi-drop" bus because of its linear arrangement of 
modules — but the memory bus is actually made up of point-to-point data bus segments 202A, 
202B, and 202C. Data bus segment 202 A connects memory controller 200 to the transfer 
port of module 150 A. Data bus segment 202B connects the forwarding port of module 150A 
to the transfer port of module 150B. And data bus segment 202C connects the forwarding 
port of module 150B to the transfer port of module 150C. In operation, module 150A, for 
instance, remains in a TRANSFER mode when it is not ACTIVE. In the transfer mode, 
module 150A merely picks up signals from either of its two ports and drives those signals to 
the other port. 

Figures 12 and 13 illustrate a variation on the point-to-point configuration of Figures 
10 and 1 1 . In Figure 13, memory bus 252 is a ring memory bus. Like memory bus 202, 
memory bus 252 contains A, B, and C segments. But in addition, memory bus 252 contains a 
fourth segment 252D that connects the last module, 2 10C, back to the memory controller 
250. When transfers occur on bus 252, half of the signals are sent in a clockwise direction 
and the other half are sent in a counter-clockwise direction. Like in the case above, modules 
that are not ACTIVE remain in a TRANSFER mode in which they propagate signals along 
the bus. But the ACTIVE module will receive data at both of its ports, and then must 
combine the data to form a full data word. 

An advantage of the ring bus architecture is that is allows point-to-point bus 
connections without doubling the number of card pins. Referring to Figure 12, each 
transfer/forwarding data port (e.g., port T/FDQ0) is only m/4 bits wide, whereas the ports in 
Figure 10 were each mil bits wide. The ring bus architecture is one way in which an effective 
bit width can be different than the number of physical lines on any given memory bus 
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segment. 

An issue with the configuration of Figure 12 is that data from two ports will need to 
be merged at some point. From Figure 13, it can be seen that depending on which module is 
active, half of the data will take longer to reach the module than the other half. This can be 
5 compensated for in several ways. First, memory controller 250 can stagger transmission on 
segments 252A and 252D such that the two halves arrive at the destination module at 
approximately the same time. Second, the interface circuit can include a multistage buffer 
that delays the data input on one module port in order to align it with the data input on the 
^ other module port. And third, data from each of the two ports can be written separately to 
l|l memory when it arrives by splitting each rank of memory in half and delaying the address 
Pi and command signals to each half by an amount that compensates for the arrival delay of the 
01 data. 

L Many other variations on the illustrated embodiments are possible. For instance, 

p although the illustrated examples use source-synchronous strobe signals to clock data, 

l|l common-clock signaling can also be used in some embodiments and/or on some data paths of 
an embodiment. The illustrated examples also show two ranks of memory, but other numbers 
of ranks are also possible, e.g., a 4:1 multiplexer and four ranks of memory. The terms 
"buffer" and "register" have been used herein somewhat interchangeably — a register has a 
latching capability, whereas a buffer may have, but need not necessarily have, such a 

20 capability. Although bi-directional registers/buffers and a combination 

multiplexer/demultiplexer are illustrated, those skilled in the art recognize that an 
embodiment of the invention can also be constructed using two data paths with unidirectional 
components. 

An embodiment can also have the capability to respond to a read that requests less 
25 than N = Rxm bits by transferring less than N bits on the memory bus. For instance, consider 

Docket #5038-63 

Client Docket #P9833 15 



a case where m = 16 and R = 4. If an allowable read operation requests only one 16-bit word, 
the module can respond by performing one 64-bit read internally to the four data registers. 
Then, only the one register of the four that contains the requested 16-bit word is multiplexed 
onto the memory data bus. This can be extended to read any number of m-bit words from 
one to R, 

Likewise, an embodiment can also have the capability to respond to a write that 
requests to write less than N = Rxm bits. Using the example above, if an allowable write 
operation requests to write only one 16-bit word, the masking bits on the other words can be 
set by the controller. The when a write to the ranks is performed, only the one word 
requested by the external memory controller will actually be written, and the other three 
words stored in the data registers will be ignored. 

The types, sizes, or numbers of memory devices selected for use with the present 
invention are not critical. Some possible device types include dynamic random access 
memory (DRAM) devices, synchronous DRAM (SDRAM) devices including double-data- 
rate (DDR) SDRAM devices, quad-data-rate (QDR) SDRAM devices, Rambus™ DRAM 
devices (with an appropriate controller), static RAM and flash memory devices. It may be 
possible to combine memory modules in a memory system according to the invention where 
two modules incorporate different types of memory devices. 

One of ordinary skill in the art will recognize that the concepts taught herein can be 
tailored to a particular application in many other advantageous ways. For instance, although 
the illustrated embodiments use one or two interface circuits and a separate module 
controller, all of these devices could be integrated in a single device, or in some other number 
of packages with some other division of the tasks to be performed by the module. The ranks 
need not be arranged on opposite sides of a card. Such minor modifications are encompassed 
within the invention, and are intended to fall within the scope of the claims. Although the 
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specification may refer to "an", "one", "another", or "some" embodiment(s) in several 
locations, this does not necessarily mean that each such reference is to the same 
embodiment(s), or that the feature only applies to a single embodiment. 
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WHAT IS CLAIMED IS: 

1 . A memory system comprising: 
a primary memory controller; 

a memory data bus, having an effective bit-width m, coupled to the primary 
memory controller; and 

at least one memory module coupled to the memory data bus, the memory module 
having a module data bus with an effective bit- width N^Rxm, where R is an integer value 
greater than one, the memory module comprising an interface circuit coupled between the 
memory data bus and the module data bus, the interface circuit capable of performing m-bit- 
wide data transfers on the memory data bus, the interface circuit capable of performing A^-bit- 
wide data transfers on the module data bus. 

2. The memory system of claim 1, wherein the memory data bus comprises a point- 
to-point bus having one data bus segment connecting the primary memory controller and the 
first of the at least one memory modules, and one additional segment for each additional 
memory module, the additional segment connecting the additional memory module to the 
module immediately preceding it. 

3. The memory system of claim 2, the memory data bus further comprising a ring 
data bus segment connecting the last of the memory modules in the memory system back to 
the primary memory controller. 

4. The memory system of claim 1, the memory data bus and the module data bus 
each having a clock rate, the memory data bus clocking at a rate R times the clock rate of the 
module data bus. 
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5. A memory module comprising: 

R ranks of memory devices, where R is at least two, each rank having an m-bit- 
wide data port; 

a module data port capable of exchanging data signaling over a memory data bus 
having an effective bit-width m; 

an interface circuit coupled between the module data port and the R memory- 
device-rank data ports, the interface circuit capable of performing m-bit-wide data transfers at 
the module data port, the interface circuit capable of performing R x m -bit-wide data 
transfers with the R ranks of memory devices; and 

a controller capable of synchronizing the operation of the interface circuit and the 
memory device ranks such that a data transfer comprising R serial data transfers on the 
memory data bus can be completed internal to the memory module with one R x m -bit- wide 
data transfer with the memory device ranks. 

6. The memory module of claim 5, wherein the interface circuit comprises: 

R ?rc-bit-wide data registers, each register capable of exchanging point-to-point 
data signaling with a corresponding rank of memory devices through the data port of that 
rank; and 

a multiplexer, having a multiplexing ratio R, coupled between the R data registers 
and the external data port. 

7. The memory module of claim 6, wherein the controller supplies rank selection 
signals to the multiplexer and register latching signals to each of the data registers. 
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8. The memory module of claim 6, wherein data signaling between a data register 
and its rank of memory devices further comprises a bit mask received from the memory data 
bus along with a corresponding m bits, the multiplexer transferring the bit mask to the data 
register along with the corresponding m bits. 

9. The memory module of claim 6, the controller capable of synchronizing the 
operation of the data registers, the module data port, and the multiplexer/demultiplexer in 
order to serialize data from a subset of the data registers onto the memory data bus. 

10. The memory module of claim 5, wherein data transfers between one of the data 
registers and the corresponding rank of memory devices occurs at a clock rate related to the 
clock rate of the memory data bus by a factor l/R. 

11. The memory module of claim 5, where the module is a dual-inline memory 
module comprising a printed circuit board capable of connection to the memory data bus via 
insertion of the circuit board into a card edge connector connected to the memory data bus. 

12. The memory module of claim 11, wherein R equals two, one of the two ranks of 
memory devices arranged on each side of the circuit board and connected to the 
corresponding data register via a set of module data signaling lines routed on the circuit 
board. 

13. The memory module of claim 1 1, where the interface circuit comprises two 
interface circuits each serving half of the module data port and half of each rank of memory 
devices. 
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14. The memory module of claim 5, wherein the module data port comprises a dual- 
port buffer, each port of the dual-port buffer capable of connection to another memory 
module in a point-to-point configuration of memory data bus segments. 

15. The memory module of claim 14, wherein each port is capable of connection to an 
m-bit-wide memory data bus segment, wherein one port comprises a transfer port and the 
other port comprises a forwarding port, the module capable of using the transfer port to 
transfer data signals between the interface circuit and a higher-level controller connected to 
the memory data bus, the module capable of using the forwarding port to connect to a second 
memory module in order to transfer data signals between the transfer port on the first 
memory module and the transfer port on the second memory module. 

16. The memory module of claim 14, wherein each module data port is capable of 
connection to an ^ -bit-wide memory data bus segment, wherein the dual module data ports 

comprise first and second transfer/forwarding ports, the module capable of retransmitting 
data signals received at one of the transfer/forwarding ports, but not destined for that memory 
module, on the other transfer/forwarding port, the module also capable of transferring 



% data signals between each of the transfer/forwarding ports and the interface circuit. 

17. The memory module of claim 5, wherein data exchanges over the memory data 
bus comprise a data strobe signal, the module further comprising a data strobe circuit to 
generate data strobe signaling when transmitting data over the memory data bus. 
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18. The memory module of claim 17, wherein the controller begins an internal 
sequence of interface circuit write operations in response to an externally-supplied data strobe 
signal. 

19. The memory module of claim 5, wherein data exchanges between the interface 
circuit and the ranks of memory devices comprise a data strobe signal, the module further 
comprising a data strobe circuit to generate data strobe signaling when transmitting data from 
the interface circuit to the ranks of memory devices, the interface circuit comprising a register 
circuit to latch data from the ranks of memory devices based on data strobe signaling 
received from those devices. 

20. A method of host/memory communication comprising: 

initiating a data access transaction, involving TV data bits, between a memory 
controller and a memory module; 

at the memory module, initiating a corresponding data access transaction between 
an interface circuit and R ranks of memory devices, each rank capable of m-bit-wide data 
transfers, R > 1 ; 

transferring the N data bits between the memory controller and the memory 
module in m-bit-wide data segments; and 

transferring the N data bits between the interface circuit and the R ranks of 

memory devices in R x m -bit-wide segments, where M = N is an integer value. 

R x m 

2 1 . The method of claim 20, wherein N^Rxm, such that for R data segments 
transferred between the memory controller and the memory module, one transfer occurs 
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between the interface circuit and the memory devices. 

22. The method of claim 20, further comprising clocking transfers between the 
memory controller and the memory module at R times the rate that transfers are clocked 
between the interface circuit and the memory devices. 

23. The method of claim 20, further comprising initiating a valid data access 
transaction when TV is an integer multiple of m, but less than R x m . 

24. The method of claim 23, wherein when the data access transaction is a write 

transaction, transferring the N data bits between the interface circuit and N / of the ranks of 

/ m 

memory devices, while signaling the remainder of the ranks to ignore the write transaction. 

25. The method of claim 23, wherein when the data access transaction is a read 
transaction, transferring Rxm data bits, including the N data bits requested for the read 
transaction, from the R ranks of memory devices to the interface circuit, and transferring the 
N data bits requested for the read transaction from the memory module to the memory 
controller. 
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DUAL-PORT BUFFER-TO-MEMORY INTERFACE 

ABSTRACT OF THE DISCLOSURE 
Methods and apparatus for a memory system using a new memory module 
architecture are disclosed. In one embodiment, the memory module has two ranks of 
memory devices, each rank connected to a corresponding one of two 64-bit-wide data 
registers. The data registers connect to two 64-bit-wide ports of a 128:64 
multiplexer/demultiplexer, and a 64-bit-wide data buffer connects to the opposite port of the 
multiplexer/demultiplexer. A controller synchronizes the operation of the data registers, the 
multiplexer/demultiplexer, and the data buffer. 

In an operating environment, the data buffer connects to a memory bus. When a data 
access is performed, both ranks exchange data signaling with their corresponding data 
registers during a single data access. At the buffer, the memory bus data transfer occurs in 
two consecutive clock cycles, one cycle for each rank. This allows the memory bus transfer 
rate to double for the same memory bus width and memory device speed. 
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and for which a patent is sought on the invention which 
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I I was filed on as Application No. 
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I I with amendments through (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the patentability of 
this application in accordance with Title 37, Code of Federal Regulations, Sec. 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Sec, 119 (a)- 
(d) or §365(b) of any foreign application(s) for patent or inventor's certificate, or §365(a) of any 
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date of the prior application and the national or PCT international filing date of this application: 
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